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ABSTRACT 

In five-dimensional heterotic M-theory there is necessarily nonzero back- 
ground flux, which leads to gauging of an isometry of the universal hypermulti- 
plet moduli space. This isometry, however, is poised to be broken by M5-brane 
instanton effects. We show that, similarly to string theory, the background 
flux allows only brane instantons that preserve the above isometry. The zero- 
mode counting for the M5 instantons is related to the number of solutions 
of the Dirac equation on their worldvolume. We investigate that equation in 
the presence of generic background flux and also, in a particular case, with 
nonzero worldvolume flux. 
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1 Introduction 

Since the realization that nonzero background fluxes play an essential role for the resolu- 
tion of the moduli stabilization problem in string and M- theory jH |2] , there has been an 
enormous amount of work on various flux compactiflcations. For a comprehensive review 
see The low-energy description of these compactiflcations is given by supergravity 
coupled to a certain number of matter and vector multiplets. The scalars belonging to 
these multiplets parametrize the moduli space of the four- dimensional effective theory. 
Depending on the preserved amount of supersymmetry, the presence of flux leads either 
to generation of a superpotential for (some of) the moduli flelds or to gauging of some of 
the moduli space isometrics. 

These isometrics survive perturbative corrections, but not necessarily non-perturbative 
ones. A source of the latter kind of contributions to the moduli space metric in A = 
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2 compactifications is provided by Euclidean branes.^ Because of charge quantization, 
these brane instantons lead to the breaking (to a discrete subgroup) of certain continuous 
isometries. The latter are the shift symmetries implied by the gauge invariance of the 
lOd or lid p-forms that couple to those branes. Since only continuous isometries can 
be gauged, there seems to be a potential clash between turning on background fluxes 
and taking into account brane-instanton effects. The resolution of this problem for string 
theory was addressed in 0. It was shown there that, in the presence of DO- and D2-brane 
instantons, the background fluxes protect exactly the isometries that need to be gauged 
thus preserving the consistency of the supergravity description. 

We will generalize their argument for the case of five-dimensional heterotic M-theory. 
A notable feature of the latter is that, unlike string theory, it does not admit vanish- 
ing background flux and so it always has a gauged isometry. This theory arises from 
considering Hofava-Witten on a CY(3) and is of interest for the following reason. The 
Hoi^ava-Witten set-up is given by M-theory on an lid manifold with boundaries or, equiva- 
lently, compactification of M-theory on an interval. To get to four dimensions, one further 
compactifies on a CY(3). This provides the strong coupling description of the Es x Es 
heterotic string compactification on the same Calabi-Yau ;6. and was argued to improve 
significantly on the phenomenological properties of the weakly coupled limit j7| . However, 
comparing to phenomenology leads to the conclusion that at some range of high energies 
the size of the interval is significantly larger than the size of the Calabi-Yau [S]. There is 
then an energy range or equivalently a time interval during the early universe evolution, 
when the universe is effectively five- dimensional.^ The implications of this picture for 
cosmology have been studied extensively in recent years 0. 

The effective action of 5d heterotic M-theory was obtained in ^Ul 1^- It is given 
by five-dimensional N = 2 gauged supergravity coupled to a certain number of vector- 
and hypermultiplets. Among them is a hypermultiplet that is the same for every Calabi- 
Yau and is hence called universal. The isometry that is gauged due to the presence of 
background flux is a symmetry of the universal hypermultiplet moduli space. On the other 
hand, one can show that this is precisely the symmetry that gets broken by the presence 
of M5-brane instantons wrapping the entire CY(3). (These instantons play a crucial role 
for moduli stabilization in 4d heterotic M-theory The reasoning is in exact parallel 

"'^ These nonperturbative corrections are essential for the stabihzation of the Kahler moduh in type IIB 
compactifications 

^At even earUer times (or higher energies) it is eleven-dimensional, whereas at later times (or lower 
energies) it becomes four-dimensional. 
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with the considerations of ^^1; which related 2- and 5-brane instantons to the breaking 
of particular isometrics of the universal hypermultiplet target space in type IIA string 
theory on a CY(3). We will see that the apparent contradiction can be resolved along the 
lines of jS]. This leads to certain topological restrictions on the Calabi-Yau three- fold in 
order for M5 instantons to be present, but these restrictions can be eased by considering 
compactifications with non-standard embedding. 

However, one could ask whether the M5 instantons contribute to the metric at all since 
a background flux can lift (some of) the fermionic zero modes living on the M5 worldvol- 
ume ^lEmSl-^ The latter works studied the influence of nonvanishing flux on the zero 
mode counting in the context of non-perturbatively generated superpotentials in = 1 
compactifications. Although it has been known for a while 18J that brane instantons 
can contribute to the superpotential, still many conceptual issues about the computation 
of their effects remain open. In the particular case of an M5-brane instanton wrapping 
a codimension-two cycle D of the internal space in an M-theory compactification on a 
CY(4), it was shown in [19^, in the absence of flux, that the instanton gives a nonvanish- 
ing contribution only when the arithmetic genus Od) of the cycle is equal to 1. This 
condition is required in order to cancel the U{1) anomaly related to rotations in the two 
internal dimensions that are normal to the M5 world-volume. In this compactification 
one obtains an exact result for the superpotential and this result can be translated into an 
exact superpotential for some particular cases in type IIB or heterotic compactifications 
via dualities.^ The recent developments regarding zero-mode counting on brane-instanton 
world- volumes, that are based on the Dirac equation derived in [21, all address the is- 
sue of how the requirement x{D-,Od) = 1 changes in the presence of background flux. 
However, even when the brane-instanton wraps the entire internal space, as is the case 
with the M5-instanton in 5d heterotic M-theory, and so there is no U{1) anomaly to be 
considered, still the supersymmetries that are broken by the brane-instanton generate 
fermionic zero modes in its world-volume theory. Hence studying the Dirac equation on 
the M5 world-volume can tell us when the brane-instanton can contribute to the moduli 
space metric. 

As is well-known [7^, the supersymmetric backgrounds in heterotic M-theory can have 
the following nonvanishing components of the lid supergravity four-form G: (2,2,0), 
■^This effect was first anticipated in |17| . 

''Tlie relation witli IIB comes via F-theory wlien the CY(4) is an elliptic fibration over a complex 
three-fold X . Then, if X is itself a P""^ fibration over a two-fold Y, one can map to the heterotic string 
on a fibration over Y PU] , 
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(2, 1, 1) and (1, 2, 1), where the first two digits are the number of legs along the holomor- 
phic and antiholomorphic indices of the Calabi-Yau three-fold respectively and the last 
one is along the interval direction. We will see that fluxes of type (2,2,0) and (2,1,1) 
do not affect the zero-mode counting on the M5 world-volume thus leading to four zero 
modes as in the fiuxless case, whereas flux of type (1, 2, 1) lifts all fermionic zero modes. 
We interpret this to mean that M5 instantons are incompatible with (1,2,1) flux back- 
grounds. For anti-M5 instantons the situation is reversed, i.e. it is the (2, 1, 1) type of 
flux that lifts all their zero modes. 

Finally, we address the role of the self-dual three-form, living on the M5 brane, for the 
zero-mode counting of the world- volume fermions. This field has always been neglected in 
the literature because its presence complicates the Dirac equation quite a lot. However, 
it is a crucial ingredient in the generalization of the arguments of 5J to our case. So it 
is natural to ask how it would affect the above considerations. We do not undertake an 
investigation of the most general situation either, but for a particular case we are able to 
solve the Dirac equation for the most generic world-volume flux allowed by the M5 field 
equations. It turns out, that in this case the world- volume flux does not affect the zero 
mode counting. 

The present paper is organized as follows. In Section|21we review necessary background 
material about 5d heterotic M-theory and its (2, 2, 0)-flux induced gauged isometry. In 
Section 121 we summarize the results of breaking of isometrics of the universal 

hypermultiplet by 2- and 5-brane instantons and explain how this translates to 5d heterotic 
M-theory. In Section |3] we tackle the reconciliation of M5-brane instantons with the 
gauged isometry of heterotic M-theory. In I4.1l we show that the M5 instantons can indeed 
contribute to the moduli space metric on the basis of the zero mode counting on their 
world- volume. In l4.2l we argue that, similarly to the case considered in jH], the Gauss's law 
on the M5 world- volume forbids exactly the instantons that would have broken the gauged 
isometry. The existence of M5 instantons, which do not break this isometry, is related to 
a topological restriction on the internal CY(3). In 14. 31 we show that this restriction can be 
eased in compactifications with non-standard embeddings. In Sectional we consider other 
types of background flux and show that the zero mode counting of the M5 world- volume 
Dirac equation is not affected by (2, 1, 1) flux, whereas all zero modes are lifted by (1, 2, 1) 
flux. In the Appendix we show that the roles of these two types of flux are reversed for 
anti-M5 brane instantons. Finally, in Section El we consider in a particular case the Dirac 
equation with nonvanishing world volume flux and find that the latter does not change 
the zero mode counting. 
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2 Gauged isometry 



The effective five-dimensional theory arising from compactification of Hofava-Witten on 
a CY(3) was considered in JIT]. It was shown there, that this is gauged supergravity 
coupled to h^'^ — 1 vector multiplets and h"^'^ + 1 hypermultiplets. The +1 is the universal 
hypermultiplet that appears for any CY(3). Its bosonic field content is the following: 
the CY volume V, a real scalar a that is dual to the external components of the lid 
supergravity 3-form C and a complex scalar ^ which comes from C = ^fi + where Q is 
the holomorphic 3-form of the CY space. The presence of boundaries in eleven dimensions 
leads to a modification of the Bianchi identity for the field strength G of C: 

where x*-^-* = and x*-^-* = np are the positions of the two boundaries. As a result, only 
solutions with nonzero background flux are allowed. That is precisely the reason for the 
gauging of the effective 5d supergravity. This gauging will be important in the following. 
So, in order to explain how it occurs, let us first introduce the relevant notation and 
conventions of jTTj. 

Let us start by taking the standard embedding of the spin connection in the first gauge 



group :^ 



trF^ A F^^) = tri? A . (2.2) 



Then (12.111 becomes: 

1 / K \ 2/3 

{dG)uABCD = (— ) [S{x'') - 5(x" - np)] [tiR A R)abcd , (2.3) 

where the indices A, B, C, D run over the six CY directions. Following j^, we introduce 
a basis v\ i = 1, .., h?'"^ = h^'^, of (2, 2)-forms on the CY such that: 

z/^' = 5i, - / i^'AiUj = 5' (2.4) 



,2/3 / « ' / J J 

where Ci is a basis of 4-cycles, Uj — a basis of (1, 1) forms and f is a 6d reference volume. 
Now, one can expand the non-exact part of tri? A R as:® 

/A \ 

tri?Ai?|„e = -Sv^TT f j aiiy\ (2.5) 



^The other Eg gauge bundle is taken to be trivial. 

^In the language of jjl] this is denoted as tri? A R\o and referred to as 'zero mode part'. Its existence 
is exactly what leads to their Gabcd\q 0, which in modern terminology is really the background flux. 
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The numerical coefficient above is chosen for convenience and 



a, = — — — -A, P^ = -— tiRAR (2.6) 



^UnJ v^^' ' Sir 



with Pi being integers related to the ffist Pontrjagin class of the CY. Using ()2.5|) . the 
Bianchi identity ()2.3|) and the field equation, DjG^'^^^ = with / = 1, 11 , can be 
solved by the following background flux: 

Gabcd = ^j^^ABCD^l^^^) 5 

Gabcu = 0, (2.7) 

where e(x^^) is the step function defined to be +1 for x^^ > and —1 for x^^ < 0. 

Now we are ready to state the result of [TT] about the fiux-induced gauging of an 
isometry of the universal hypermultiplet moduli space. Let us denote the coordinates on 
the latter by = {V,a,C,,C,)^- Then the kinetic term of the universal hypermultiplet is 

m 

K^D^q^D^q- , D^q = {d^V, d^a - 2e{x'')a,A'^, d^^, dj) , (2.8) 

where huv is the metric on the quaternionic space SU{2, l)/f/(2) and Al^ are h^'^ gauge 
fields arising via CaAB = \-A\uJiAB with the index a running along the five non-CY 
dimensions''. Clearly, the isometry a ^ a + const of the metric h^v is now gauged 
because of the nonzero background fiux G = aiU^e^x^^). The dualization that relates a 
and Gafd-js is accordingly modified: 

G = -^V-^ *5 [da - 2e{x^^)aiA' - ii^d^ - ^d^] ■ (2.9) 
v2 

Finally, comparing (j2.8p with the general expression for the extended derivative, D^q^ = 
daQ^ + gA^Jx-i, we see that the Killing vectors fcj are:*^ 

ki = -2e{x^^)aid„ . (2.10) 

Although defining ki as above will be of use for us, we should note that strictly speaking 
there is only one Killing vector: k = d^. So, in fact, the gauge field for the gauging is a 
linear combination of the graviphoton and the vectors from the vector multiplets, which 
is given by Aa = —2e{x^^)aiA^^. 



'^The number of vector multiplets is /i^'^ — 1 because one of the /i^'^ vectors (rather, a certain 
combination of them) is the graviphoton of the supergravity multiplet. 

^For convenience we set the gauge coupling constant g — 1; or, equivalently, we absorb it in the 
definition of a, . 
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3 Five-brane instantons 



In ^3] it was shown that 5-brane and 2-brane instantons lead to the breaking of certain 
isometries of the universal hypermultiplet moduli space. The considerations of that paper 
were in the context of type IIA compactifications on a CY(3) to a four- dimensional effec- 
tive theory with N = 2 supersymmetry. In this case the bosonic content of the universal 
hypermultiplet is made up of the dilaton (p, a real scalar D that is dual to the external 
components of the B-field and a complex scalar C originating from yl(3) = CQ, where 
A(3) is the RR 3-form potential. The precise relation between D and H, which is locally 
Hf^up = {.dB)^up with /i, z/, p being four-dimensional indices, is given by 

H = 6^"^ *i[2dD + i{CdC -CdC)]. (3.1) 

The manifold parametrized by ip, D, C, C is the coset SU{2, 1)/U{2) [22] • In terms of the 
complex coordinates S, S, C, C, where 

S = 6-^"^ + 2tD + CC , (3.2) 

this coset has the following symmetries: 

S ^ S + ia + 2{-f + i(3)C + -f^ + (3"^ 

C C + -f-i(3, (3.3) 

which correspond to constant shifts of the NS axion D and the RR scalars C, C. These 

symmetries are invariances of the classical Lagrangian. Their existence is implied by the 

gauge transformations^ of the 3-form H and 4-form F(4) = dA(^3). As shown in [23] 5 they 

survive when sigma-model perturbative corrections are taken into account. They are also 

expected to survive in string perturbation theory [21].^° (By contrast, the remaining 

symmetries of the coset SU{2, 1)/U{2) are generically broken by perturbative effects. ^^) 

However, non-perturbative corrections due to membrane and five-brane instantons will 

break the isometries in ()3.3|) |13j . Let us recall the argument for this. 

^Recall that gauge invariance implies lack of non-derivative couplings of the corresponding potentials, 
which in turn gives rise to exactly the shift symmetries of the scalars obtained from reduction of those 
potentials. 

^°The perturbative corrections to the moduli space of the universal hypermultiplet were first addressed 
in [21] and studied more thoroughly in |25l I26| . 

-•^^For more details on the symmetries of the coset SU{2, 1)/U{2) see |27| . 
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It was shown in ^3] that the symmetries ()3.3p give rise to the Noether currents 
j„ = ^e^K {dS -dS + 2{CdC - 2CdC)) , 



Jp = -^e^{dC -dC) +2{C + C)J^, 

= -^e^{dC + dC) -2i{C -C)J^, (3.4) 

where K is the Kahler potential K = — ln(S' + S — 2CC). Integrating these currents 
over a three-cycle E3 in the 4d external space, one obtains the corresponding conserved 
charges: 

Qa,/3,7 = / *4 '^a,/3,7 • (3-5) 

However, these charges can be shown to be related to the presence of 5-brane {Qa) and 
2-brane ((5/3, Q-y) instantons. For example for the 5-brane, the case that will be of impor- 
tance for us, one can easily see from (j3.2j) and ()3.H1 that 



Qa= nJa= H, (3.6) 

7 S3 J S3 

where we also used that K = ~ \n{S + S — 2CC) = 2ip. Clearly then, Qa is the five-brane 
charge and so charge quantization implies that the presence of 5-brane instantons breaks 
the symmetry generated by (i.e. the symmetry S S + ia) to a discrete subgroup. 

Let us now compare the above type IIA compactification to a 4d = 2 theory 
with the compactification of Hofava-Witten on CY(3), that leads to a five- dimensional 
effective theory. In both cases there are eight preserved supercharges. In addition, the 
scalars V, cr, ^, ^, introduced in the previous section, parametrize the same quaternionic 
manifold, SU {2,1) /U{2), as do ip,D,C,C. The coordinate transformation between the 
two sets of coordinates is: 



a 



2D, V = e-^'^, i = C. (3.7) 



Hence, the same symmetries as ()3.3p are also present for the moduli space of the universal 
hypermultiplet in the 5d theory. And similarly to the type IIA case this leads, upon using 
(j2.9j) . to the shift symmetry a ^ a + a being broken by the presence of five-brane charge^^ 

Qa= j HJa= [ G, (3.8) 
J S4 J S4 



^^For further study of 2- and 5-brane instanton effects on the universal hypermultiplet moduli space 
in the supergravity description see j28| . 
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Since D — ImS, clearly the shift S ^ S + ia is actually D D + a. 
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where E4 is a four-cycle in the five-dimensional external space. ^ 

However, as we recalled in Section |2l the isometry a ^ a + const is gauged because 
of the presence of background fiux in the CY compactification of Hofava-Witten theory. 
Since only continuous isometrics can be gauged, it appears therefore that there is a clash 
between this gauging and the possible five-brane instanton effects. 

4 Flux-induced gauging vs M5 instantons 

In the present section we address the reconciliation of the above competing effects. First, 
in I4.1l we explain that five-brane instantons can exist in the theory we are considering and 
so there is indeed a potential problem. In 14. 21 we show that the latter is resolved, similarly 
to the string theory case, by requiring that Gauss' law is obeyed on the brane-instanton 
world-volume. This implies that the background fiux allows only instantons that would 
not break the gauged isometry. If such M5's are to exist, then the CY has to satisfy some 
topological constraints. In 14.31 we show that these constraints can be made less restrictive 
by considering compactifications with non-standard embedding due to the presence of 
Minkowski M5-branes in the bulk. 

4.1 Fermionic zero modes and 5-brane instantons 

To claim that there is a possible clash between the gauged isometry, parametrized by the 
coordinate a, and five-brane instantons, let us first convince ourselves that the latter are 
not forbidden by supersymmetry. In [SI? it was shown that, to first order in the k^^^ 
expansion of Hofava-Witten theory, supersymmetry allows only Minkowski membranes 
that stretch between the two boundaries and Minkowski five-branes that are parallel to 
the boundaries. These are solutions in which the M2 and M5 branes are part of the 
background. Nevertheless, it is natural to expect that the same conclusion will hold for 
their instantonic counterparts. Indeed, it was shown in [HI] that the only M2 instantons, 
which are compatible with supersymmetry, are given by membranes wrapping holomor- 
phic curves on the boundaries and stretching along the eleventh direction. The argument 
was based on analyzing what embeddings of the membrane worldvolume into the eleven- 
dimensional spacetime allow solutions of Fe = e, where F is the worldvolume operator that 
defines the K-symmetry transformation and e is the supersymmetry parameter. Clearly, 
one can perform an analogous computation for the 5-brane instantons. However, it will 
""^"^A similar conclusion was reached in |29| from a different point of view. 
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be of future use for us to verify the existence of instantons, due to M5-branes wrapping 
the whole CY(3), by counting the fermionic zero-modes on the brane worldvolume. 

Recall that the supersymmetries that are broken by the presence of a brane generate 
fermionic zero modes on its worldvolume.^^ In order for a brane- instanton to be able to 
contribute to the moduli space metric of the external theory, the Dirac equation for its 
worldvolume fermions has to have four zero modes. Note that, in addition to the zero 
modes coming from the broken supercharges, there can also be zero modes related to 
internal degrees of freedom (i.e., superpartners of bosonic deformations of the internal 
cycle). Furthermore, recently it was shown that background fluxes can change the zero- 
mode counting significantly O^].^^ These results were based on the Dirac equation for 
the M5-worldvolume fermions in a nonvanishing background, derived in |21 . The latter 
work considers only the quadratic terms in the fermionic worldvolume action. However, 
this is enough for ruling out M5-brane instanton contributions (in the case of less than 
four zero modes) since the higher (interaction) terms can only lift zero modes of the 
quadratic action but not introduce new ones.^^ As we reviewed in Section |21 in the case 
of interest for us there is nonvanishing background flux. So we are going to show that 
there are exactly four zero modes on the worldvolume of an M5 wrapping a CY 3-fold by 
specializing the Dirac equation of j^I] to our set-up. 

Let us start by decomposing the eleven-dimensional spinor in the appropriate way. 
To begin with, it transforms in the 32 of 5*0(1, 10), or in Spin{l, 10) to be more precise. 
Compactifying on CYxM^x ^VZa, the group ^0(1, 10) gets broken to SU{3) x S0{1, 3). 
After analytic continuation to Euclidean space, the latter group becomes SU{3) x 50(4). 
Hence the spinor, 6, on the worldvolume of an M5-brane wrapping the CY(3) transforms 
in the (1, 4) © (3, 4) © (3, 4) © (1, 4). Defining the Clifford vacuum \n) by 



where the index a runs over the holomorphic coordinates of the CY, one can expand 9 as 



^'"^For a nice recent discussion of this point see II 6|. 

""^^An apparent contradiction in this kind of analysis, related to the consistent inclusion of non- 

perturbative effects in the minimization of the 4d effective superpotential, was resolved in 32^ . 

^^Recall that, in principle, counting arguments can only be enough for ruling out certain contributions. 
However, they do not necessarily imply a non- vanishing correction since even when they do not rule it 
out, the explicit computation may end up giving zero. 



7"|fi) = 



(4.9) 



9 = 4>\n)+ • 



(4.10) 
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Recall that this expansion contains only terms with even number of indices because after 
K-symmetry gauge- fixing one is left with a chiral fermion on the worldvolume [21]. Also, 
we have suppressed the 4 index on 0, 0^^^ for simplicity. 
Let us now turn to the Dirac equation [21]: 

lAm^^VBO + ^ [r^'^''{25l - m^^)GBa/35 + I'^l^'''' {25^ - 3mA^)Gz5BcJ = . 

(4.11) 

As before, indices a, /5, 5 run over the five dimensions that are transverse to the CY (and 
so to the M5-brane instanton) and A, 5, C, D run along the six worldvolume directions. 
Also, the matrix m is determined by the worldvolume 3-form flux h via 

m^^ = - • (4.12) 

For convenience, from now on we will absorb the 1/24 factor in the definition of the 
background flux G. To simplify the problem we will consider in the following, as in all 
existing literature, only vanishing worldvolume flux. (We will have more to say about the 
/i 7^ case in Section 0) Hence (|4.11|) reduces to: 

7" V.e + 7' V,^ + (7"^'7''G'^a/35 - i'^I^^'^'Gabco) ^ = . (4.13) 

Since the background flux in ()2.7|1 has only Gabcd nonzero components, clearly the Dirac 
equation ()4.13j) is completely unaffected by the flux. Hence the counting of zero modes 
gives four, which is what is necessary for the M5 instanton to contribute to the metric. 
Indeed, substituting ()4.10|) in ()4.13|) . one finds 

(a,0 + 4/^9,0-,,)7lfi) = 0, (4.14) 

where g^i is the Kahler metric on the CY. Hence, as in |T3], the forms (f) and are 
harmonic. However, as h^'"^ = for a CY(3), it follows that (p^i = 0. So we are left with 
the single component (p, which due to the suppressed index in the 4 of 5*0(4) means that 
there are exactly four zero modes. Therefore, M5-brane instantons are in principle allowed 
in the theory under consideration, despite the existence of the fiux-induced gauging of the 
shift symmetry along a (which is the isometry they are supposed to break). 

^^Recall that this can be derived in the following way. Acting with V" on the second equation in 
(14.14(1 . we obtain that A(p = 0. On the other hand, acting with Vj on the second line of H4.14|l and 
anti-symmetrizing w.r.t. the pair (a, d) gives, after adding the result of the action of V on the first 
line of (|4.14() . that A(pi^ = 0. These manipulations use the fact that on a Kahler manifold the only 
nonvanishing components of the Christoffel symbols are F^^ and Vi^^ and also Ralcd — ^adcb = ^ctad- 
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4.2 Reconciling M5 instantons with flux-induced isometry gaug- 
ing 

It turns out that the resolution of the above puzzle is along the lines of ^ , which consid- 
ered D2-brane instantons and flux-induced gauging of isometries in type II strings. The 
idea is the following. The correction to the moduli space metric, due to brane-instanton 
effects, is of the form Te"^'"^* , where Smst is the brane action and the prefactor T is made 
up of one-loop determinants. Generically T can depend on some of the moduli but not 
on the p-form ones, whose shift symmetries are broken by the brane-instanton (in our 
case, the coordinate a) , because the dependence on the latter is fixed by the charge of the 
instanton.^^ In other words, the above p-form moduli enter the brane-instanton induced 
correction only via Sinst- Hence, it is enough to show that the change of Sinst, generated 
by the Killing vector of the isometry to be gauged, vanishes for brane-instantons that are 
compatible with the background flux (i.e., satisfy the appropriate Gauss' law). 
Let us start by recalling the covariant Minkowski M5-brane worldvolume action 



_ j (^c'(6) + 1faC(3)^ , (4.15) 
where m, n are worldvolume indices, a{x) is an auxiliary field and 

TT rp /^(3) TT*lmn Imnpqr tt tt ^mnl^ " /a i 

J^lmn — J^lmn ^Imn-: ^ ~ ol / J^pqr ■, J^mn — , ■ V^- ) 

Finally, F = dA is the field-strength of the 5-brane worldvolume two-form field A. Recall 
that F (or, equivalently, H) satisfies a non-linear self-duality condition and there is a 
non-linear field redefinition that relates it to a worldvolume 3-form h, which obeys an 
ordinary linear self-duality constraint but is not related to a potential. Let us also note 
that the auxiliary field a{x) can be gauged away and in the gauge, in which a{x) is 
equal to one of the worldvolume coordinates, the second term on the first line of ()4.15p is 
of the form 

'"(F-C(3)) A(F-C(=^)). (4.17) 



^^In the case of brane-instanton generated superpotentials (i.e., in iV = 1 compactifications), T is a 
function of the complex structure moduh but, due to holomorphy, not of the Kahler ones (see 
However, for non-perturbatively generated corrections to the moduh space metric, clearly there is no 
holomorphy and so one cannot exclude Kahler moduli dependence of the instanton prefactor. 

^°More precisely, the relation between the two fields is -f/zmn = (i5f — 2hipgh^){Sfh — '2hmp'Q' hS^^)hnrs 
Pl| in terms of flat indices, or equivalently Hi„in = {m~^)iPhmnp |35|. 
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Euclidean continuation of the above action is achieved, as usual, by taking the worldvol- 
ume time to ±ix^. 

Now, in order to follow the logic of jS] we want to see what is the explicit dependence 
of the five-brane action on the scalar a so that we can compute the change of Sm5 under 
the transformation generated by the vector field ki (see eq. ()2.10|) ). Since *^dC^^^ = da 
with C^^^ having only external (which in particular means non-worldvolume) indices, no 
terms with C^^^ in Sm5 contribute cr-dependence.^^ On the other hand, the lid duality 
*iidC^^^ = dC^^^ descends to C^^^ = aw, where w is the CY volume form. Hence 

SSm5 = HSm,) = H j C^'^) = -2e(x")«, . (4.18) 

So, as long as ai 7^ 0, the action is not invariant. However, on the M5 worldvolume, X, 
dH = —\G [SI!, where G is the (puUback of the) background flux. Therefore, on X the 
flux G has to be cohomologically trivial. From (|2.7p this implies that on X 

ai = \fi , (4.19) 

which restores the invariance of Sm5- So the background flux does not allow five-brane 
instantons, unless the CY(3) is such that 

/ tTRAR = (4.20) 
Jci 

for every 4-cycle Ci, in which case the isometry a ^ a + const is not gauged anyway. 
Clearly, the conditions (|4.2Uj) are satisfied for Calabi-Yau's with vanishing first Pontrjagin 
class. 



4.3 Non-standard embedding 

In (j2.2|) we assumed the standard relation between the Eg gauge group of the visible 
boundary and the spin connection of the CY space. However, non-standard embeddings 
allow other (than Eq) unbroken gauge groups on the visible boundary and so have at- 
tracted a lot of phenomenological interest on their own. (They were introduced in the 
context of the weakly coupled heterotic string back in (SH]-) Even richer possibilities for 
the breaking of Eg x Eg arise when one considers M5-branes parallel to the boundaries 
and situated at various positions along the interval. These five-branes are extending along 

^^We use ^sdC*^^^ ~ da instead of the full relation H2.9(l . because we concentrate only on the cr (as 
opposed to ^) dependence and keep only terms linear in k^^^. (As the Killing vector is proportional to 
ai ~ K^/'^, in ki{SMb) the terms of 0{k^/^) come from the part of S'ms that is zeroth order in k^^^.) 
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the four external directions and wrapping a holomorphic curve in the CY(3). Including 
them is incompatible with the standard embedding. For an undoubtedly incomplete list 
of the vast literature on phenomenology of these compactifications, see |37j . 

The low-energy effective theory of the strongly coupled heterotic Eg x Eg string on 
a CY(3) with non-standard embedding (with or without five-branes) was derived in |38j. 
Depending on the energy regime of interest it is useful to compactify either to four or to 
five dimensions. In the latter case, one again obtains five-dimensional gauged supergravity 
in the bulk. The effective theory has the same form as the one for the standard embed- 
ding 11 , but the gauging parameters are now different from ()2.6p . For non-standard 
embedding without five-branes:^^ 

~ y (^trF(^) A F(^) - ^tri? A , (4.21) 

whereas in the presence of n M5-branes, positioned at xi, a;„ along the eleventh dimen- 
sion, the parameters change in each interval Xk < x^^ < Xk+i- More precisely, one finds 

k 

~ J] P?^e{x'') for x'' G {x,, x^+i) , (4.22) 

r?i=0 

where xq and Xn+i denote the positions of the visible and hidden boundaries respectively 
and the integers (3^''' = J^^'^ are topological invariants giving the intersection number 
of the k-th five-brane with the four-cycle Cj for k = 1, ...,n and i = 1, /i^'^. 

As in Section |2l the isometry of the universal hypermultiplet moduli space that is 
gauged is generated by k = d^- So, following the arguments of Section 14. 2t we again 
conclude that five-brane instantons are allowed only when the relevant gauging parameters 

(k) 

al vanish. However, since the Minkowski M5-branes are themselves magnetic sources of 

(k) 

flux, one can achieve the vanishing of a) with an appropriate choice of M5-branes in the 
bulk without the need to impose ()4.20|) on the CY(3). Hence, the topological conditions 
that the Calabi-Yau should satisfy, so that there can be 5-brane instantons, are least 
restrictive for non-standard-embedding vacua with bulk M5-branes. 

5 More general background flux 

So far we have considered only background flux of type (2,2,0), i.e. Gaicd- As we saw, 
it does not affect the Dirac equation of the M5 world-volume fermions. However, in 
^^The precise numerical coefficients will not be important for us, so we will omit them for clarity. 
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heterotic M-theory one could also have supersymmetric backgrounds with nonvanishing 
flux components of type (2, 1, 1) and (1, 2, 1), i.e. Gabcu and Gagcii! see, for example, j^Hl- 
Such components appear also in a background including the gauge five-brane considered in 
pnj.^^ Let us now see how they modify the zero-mode counting for M5-brane instantons. 

In a vacuum with nonzero Gabcu and Ggj^^n, the Dirac equation on the worldvolume 
of an M5 instanton^'' (still neglecting the worldvolume flux h) acquires the form: 

(%0Sci+4G[,/|n|0.iJ + 2G'^"j[,|n|05ei^ = 

(d-a(f) + 4g''d,(P-,,-8G,nbc<p'' + 8G,u''<Pu + 2G-Ji,^^ = 0, (5.1) 

where we have used, as before, the decomposition (j4.1(J|) . At first sight, equations (j5.1|) 
look quite complicated. However, their analysis can be facilitated by the following obser- 
vations. Since they are linear in the flux, one can study the contributions of the (2, 1, 1) 
and (1, 2, 1) components separately. Furthermore, on physical grounds turning on back- 
ground flux can only reduce the number of zero modes compared to the fiuxless case.^^ 
However, the presence of flux can deform (some of) the surviving zero modes. Let us 
see what do the above considerations imply in our case. For vanishing flux the four zero 
modes (recall that for convenience we have suppressed the 4 index of (p, were given 
by - harmonic and = 0. Hence, if it is possible to have ^ for G 7^ 0, then 
the (f)^i solution must be completely determined by the solution for 0, together with the 
flux. Otherwise the number of zero modes will increase by 3 x 4, which is the number of 
independent components of 0^5. 

Now we are ready to start analyzing the system ()5.1|) in the presence of each of the 
two allowed types of flux. Let us begin with (2, 1, 1) fluxes. In this case the equations 
become: 

^[a05c] = 

9,0 + 4/'=9,05,-8G',nf,e0'^ + 8an^V-6a = 0. (5.2) 

Acting on the second equation with Vj, together with antisymmetrizing w.r.t. d and a, 

^■^This is the lift to strong coupling of the heterotic string solution of j4()| . 

^"^Not to be confused with the Minkowski gauge five-brane that may be a part of the background. 

^^The reason is that for nonzero flux there are additional supersymmetry constraints (for example, 
primitivity conditions for flux components) . Satisfying them leads to smaller number of geometric moduli 
and hence also to smaller number of their superpartners, which are the fermionic moduli. 
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and adding to the result the action of V" on the first equation, we find:^^ 

A<^j, = 8 (V[,-|aii'=^ + G,n'=^V[j|) - 8 (%G,]n^^" + G[,|n^'V|j]) 0-,, . (5.3) 

The system fl5.3|) consists of three coupled equations for three unknown functions. Any 
solutions (j)g]j are determined by the flux only. In other words, the (p^i zero modes do not 
depend on 0. On the contrary, from the second equation in ()5.2|1 one can determine in 
terms of the flux and the solutions for 0^^;. Hence, the number of solutions is determined 
by (p^i and therefore for generic flux it is larger than in the fluxless case. The only way 
to reconcile this with the observations in the paragraph below the system ()5.H) is to 
assume that the solution is in fact 0^5 = 0, which then implies that is harmonic. So the 
conclusion is that generic (2, 1, 1) flux does not affect at all the zero modes. 

Now let us turn to the (1, 2, 1) type of flux. In this case the system ()5.H) reduces to: 

%05c] +4G[a6'^|ll|^c]d + 2G"^J[a|ll|0fec] = 

a,0 + V'^ae05a + 2GaAi0 = 0. (5.4) 
Acting with V" on the second equation, we find: 

A0 - 4G-aAid~^4> - ^d~^G-Ju)(p = . (5.5) 

The second-order linear differential operator acting on in the above equation is clearly 
elliptic. Since we are on a compact manifold, its spectrum will be discrete and so nontrivial 
solutions for will exist only if one of the eigenvalues is zero. This is clearly the case for 
vanishing flux, when the operator reduces to the laplacian and hence is harmonic. But 
for nonzero flux (unless the flux is very particular) the eigenvalue will typically be shifted 
away from zero. We conclude that, generically, the only solution of ()5.5p is = 0. In 
other words, generic flux completely lifts the zero modes of the fluxless case. 

To recapitulate, turning on generic flux of type (1,2,1) lifts all zero modes. Again, 
there may be important exceptions for very special choices of flux. On the other hand, 
a background flux component of type (2, 1, 1) does not affect the zero mode counting, 
similarly to the (2, 2, 0) component. We should note though that the situation is reversed 
for anti-M5-brane instantons. Namely, all zero modes on their worldvolume are lifted by 
a generic (2, 1, 1) flux, whereas the (1, 2, 1) type of flux does not affect them. For more 
details see the Appendix. 

26Recall that Acj)^^ = 2Ag = -2V^Vs (t^ah - '^Ra^h'^ <Pcd = -2V^Vc«i'a6, where the last equahty is 
due to Robed — R-adcb ^ Kahler manifold. 
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6 World-volume flux 



Until now, our considerations of the Dirac equation on the worldvolume of an M5-brane 
instanton always neglected for simplicity (as in all existing literature) the self-dual three- 
form h. However, as we saw in Section 14.21 h plays an important role in the resolution 
of the problem of reconciling five-brane instantons and gauged isometries. Hence, it is 
natural to ask how its presence affects the zero-mode counting of the previous sections. 
Unfortunately, taking into account both /i 7^ (or equivalently, Himn = {jn~^)fhmnp 7^ 0) 
and nonvanishing background flux is too complicated to address in full generality. In the 
particular case of (2, 2, 0) background though, the Dirac equation simplifies significantly 
and we will be able to analyze it in the presence of nonzero worldvolume flux. As a result, 
we will see that, whenever the topological constraints of Section 021 (or the conditions in 
Section 1321) satisfied, the presence of M5-brane instantons is allowed by the zero- mode 
counting even with h ^ 0. 

6.1 Preliminaries 

Since background fluxes of type (2, 2, 0) (as those considered in Section do not con- 
tribute to the Dirac equation ()4.11|) . for such backgrounds the latter simplifies to: 

7Am^^VB^ = , m^^ = - 2h^cDh'''''' . (6.1) 

To make further progress we will use the solution for h found in [4Tj (see also j32]): 

h = cn + x- (6.2) 

Here Q is the CY (3, 0)-form, x is a primitive (l,2)-form and c is a constant, which for 
convenience we will absorb in the definition of Q from now on. This is the most general 
form of the worldvolume flux for an M5 instanton wrapping a CY(3) in the absence 
of background fiux.^^ Nevertheless, it is all we need since effectively the compatibility 
condition between the background flux and M5 instantons is that the pullback of the flux 
on the brane worldvolume be zero (see Section 1^^ . Substituting ()6.2|) in equation 1)6.11) 
and using the decomposition ()4.10|) of the world-volume fermions, we find: 

(40 + 4^''^"ab0c-a-16/i^V,05a-4l/,'ab0)7l^ = 

(a[,0-,,-]-4z/[/9|,|05,])7''l^^) = 0, (6.3) 

^^Nonzero background flux complicates significantly the field equation for h and the generic solution 
in that case is not known. 
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where for convenience we have introduced the combinations:^^ 

= X-acdX'"^ , /ia' = ^acdX'^" , (6.4) 

and used the relation /i"^ = /x^", whose origin will be recalled shortly. Note that, inverting 
the second relation above i.e. using Xalc = l-'-a^'^dbci can write = Hc'^VL^del^g^^^^'^- 

In order to be able to solve equations ()6.3p . we will need one more result from [I41j. 
Namely, the (1, 2)-form x, that determines the world- volume flux via ()(j.2j) . has to be of a 
very particular form. Let us briefly recall the reasons for that. The self-dual three-form 
h is determined by its equation of motion 



m^^'VAhBCD = . (6.5) 
The (1, 1) and (0, 2) components of the latter give respectively 

d[afibf - 4:Cfi[/dai^bf = , (6.6) 



which is exactly the Kodaira-Spencer equation |33] that describes finite deformations of 
the complex structure of the CY(3), and 

V^XaSc- - 4x.rfe-X^''V^X/5c- = , (6.7) 

whereas the (2, 0) component vanishes identically due to = 0. In addition, the 
primitivity condition J A x = leads to 

IJ-ab = fJ'ba ■ (6.8) 

Equation ()6.7|) is a deformation of the gauge choice d^x = in which the solution of ()6.6|) 
was found by Tian and Todorov |13]. This solution has the form 



oo 
n=l 

with e being a small parameter, and satisfies ()6.8|) automatically.^^ As the precise form 
of the functions x^"'^ is not important for us, we will not write them down. It was argued 
in IH] that the Tian- Todorov solution can be deformed to a new one, still of the form 
()fi.9j) . which satisfies the gauge condition ()(17|) together with (jdfij) and ()fi.8j) .'^° In view 
^^Our definition of fia'' differs by a factor of 1/2 from the one used in |41| . 

^^Tliis solution of the Kodaira-Spencer equation has also been considered in the context of the topo- 
logical B-model in |45j . 

^°We should note, that although presents convincing arguments, it does not give a rigorous proof. 
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of this, we take the worldvolume flux parameters in the Dirac equation ()6.3|) to also be 
power series in e: 

oo oo 

^ = J2 e>(") , iy = Yl e'"'^^'"^ ' (6-10) 

n=l n=l 

where the expansion of u has only even powers because of ()6.4|) . This implies that the 
solutions of ()6.3|1 should also be power series: 

oo oo 



E^V"^ '^.5 = E^>it (6.11: 



n=l n=l 



6.2 Solving the Dirac equation 

Let us now start solving ()(i.3j) order by order in e. At first order we have the system: 

= 0, (6.12) 

which implies that (f)^^'^ and (j)^^^ are harmonic. Using h^''^{CY{3)) = 0, we find that 
(f)^^^ = 0. Hence, at second order ()6.3|) gives again: 



be] 



d[JS = 0' (6-13) 



since the only term containing fi or u would have been 16/i(i)^^V60^y. Therefore, 0(2) 
and are also harmonic and as a result ^^g"* = too. 
At order e'^ we find a more complicated system: 

= 0' (6-14) 

where we have used the vanishing of 0^^^ and 0^^\ Note that these equations are of 
exactly the same form as (3.11) and (3.13) of 14^ with Aiy^'^\^db(j)^^^ playing the role of 
the inhomogeneous fiux term. However, in our case things are even simpler as we have 
already found that 0^^^ is harmonic. Since a harmonic function on a compact space is 
necessarily constant, dh4>^^^ = 0. Therefore, we again find that 0''^'*, (jyi^ are harmonic and 
so 0(J = 0. 

It is easy to generalize the above considerations to any order, but before doing that, 
let us gain more familiarity with the equations involved by writing down the systems that 
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result for two more iterations. At order ()6.3p gives: 



diJ£ = 0, (6.15) 



whereas at order e^: 

A:=l k=l 

a[,0g-4z.(2)[/a|,|0g = 0. (6.16) 

It is clear now that at order e"" one has: 

= sSi, (6.17) 
where for convenience we have introduced the notation 

n-3 [n/2] 

k=l k=l 

[(n-3)/2] 

k=l 

and the upper limits in the sums take into account that 0^^^ = 0. Obviously T^^^ 
and S^jg depend only on 0'^'^) and 0^^^ with k < n, which at the previous stages have been 
shown to be harmonic. The latter fact implies that (f)^^^ = and d^cj)'^^^ = 0, which leads 
to 

Ti") = 0, ^£^ = 0. (6.19) 

Hence 0*-"'' and (p^^ are also harmonic. 

To recapitulate, the solution of ()6.Hp is given by (p^i = and - harmonic. Since 
h^'^{CY{3)) = 1, we find a single zero mode. Taking into account the 4 index that we 
have suppressed for convenience, this means that there are four zero modes just as in the 
case without world-volume flux. 



7 Discussion 

In this work we considered the interplay between flux-induced gauging of isometrics and 
M5-brane instantons in five-dimensional heterotic M-theory. We showed that the recon- 
ciliation of the above two competing effects is due to the enforcement of the Gauss' law 
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on the instanton worldvolume. It occurs for CY 3-folds that satisfy certain topological 
constraints. We explained that these constraints are significantly eased by considering 
compactifications with nonstandard embedding. In addition, we investigated in detail the 
Dirac equation for the M5 worldvolume fermions in the presence of all possible types of 
supersymmetric background flux. It turned out that backgrounds of type (2, 2, 0) and 
(2, 1,1) do not change the zero- mode counting of the fiuxless case, whereas flux of type 
(1, 2, 1) lifts all zero modes. (For anti-M5 instantons the roles of the (2, 1, 1) and (1, 2, 1) 
fluxes are reversed.) We also managed, for first time, to solve the Dirac equation with 
nonvanishing worldvolume flux, although under restricted conditions. 

In heterotic M-theory there is always background flux, as we recalled in the intro- 
duction. So it was indeed pressing to show the consistency of the gauged supergravity 
description when non-perturbative effects are taken into account. However, clearly one 
can turn on background flux in M-theory compactifications to five or four dimensions 
as well. While the four-dimensional case is important mostly in the context of moduli 
stabilization, the five-dimensional one is relevant also for the domain- wall/QFT corre- 
spondence jin] and supersymmetric realizations of the Randall-Sundrum scenario flTj. 
With the latter motivation in mind, the work jlHI studied M-theory compactifications 
to 5d with background flux and, in particular, derived the flux-induced gauging in the 
effective supergravity description'^^, similarly to the results of jSU] for type II strings. It 
turns out that again the isometry of the universal hypermultiplet moduli space, that is 
given by constant shifts of the axionic scalar cr, is gauged by the flux.^^ Hence the consid- 
erations of the present paper apply, pretty much literally, to this well. Finally, it 
is certainly of interest to also study, in the same vein as here, the zero mode counting on 
the worldvolume of membranes in M-theory flux compactifications to 4d as M2 instantons 
could contribute to the superpotential of the low-energy effective theory. 
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A Zero-mode counting for anti-M5 instantons 

In the main text we considered M5-branes and, in order to construct an exphcit repre- 
sentation of the fermion states on their worldvolume, we defined the Chfford vacuum by 
7"|0) = 0. Then the states are obtained by acting on \Q) with the creation operators 7°. 
To represent the fermion states on an anti-M5-brane worldvolume one can define another 
Clifford vacuum \Q') by 

7^|fi') = . (A.l) 

Now the creation operators are 7" and so the decomposition of the worldvolume spinor 6' 
is: 

9' = <PW + ^'ab^'l^') ■ (A.2) 

This is in accord with the realization of anti-brane worldvolume states in string theory 
as complex conjugates of the corresponding brane states. Therefore, it is immediately 
obvious that anti-M5 instantons couple to the fiuxes of type (2, 1, 1) and (1, 2, 1) in an 
opposite way compared to the M5 instantons. Hence it follows from the results of Section 
E] that the (2,1,1) fiux lifts all of their zero-modes, whereas the (1,2,1) fiux does not 
affect them. 

It is worth noting that, unlike the case of anti-D-branes, for anti-M5-branes there 
is an alternative representation of the fermionic states. This is due to the fact that 
their worldvolume spinor 6' has definite chirality, which is correlated with the self-duality 
properties of the world- volume three-form h. More precisely, 6' is anti-chiral and so can be 
built as an expansion in terms of odd number of creation operators acting on the original 
vacuum \Q): 

9' = <i)-,r\^) + cp,-,,r''\n). (A.3) 

Clearly, if the two representations ()A.2|) and ()A.3|) are to describe the same physics, they 
have to be equivalent. And indeed they are, since one can write an explicit mapping 
between them: 

m = and = , = fi,,=>,- , (A.4) 

which is essentially the statement of Serre duality for the Calabi-Yau 3-fold. 
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